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(57) Abstract 

The invention relates 
to the generation of a trick 
play information stream from 
a normal play information 
stream, so that they can 
be recorded together as a 
composite information stream 
on the record carrier, such 
that upon reproduction in 
a trick play reproduction 
mode, an information signal 
of sufficient quality, e.g. 
as regards visibility, can 
be obtained. One aspect of 
the invention lies in the 
generation of GOPs, each 
GOP comprising an I-frame 
retrieved from the original 
normal play information 
stream, and one or more 
so-called "empty P frames". 
Another aspect of the 
invention is the requirement 
of generating GOPs for the 
trick play information stream 
that have a constant bitcost 

per GOP. Again another aspect of the invention lies in the retrieval of the I-frame for the trick play information stream from the normal 
play information. More specifically, an I-frame is generated by retrieving from an I-frame included in the normal play information, the 
DC coefficient of the I-frame and a number of AC coefficients from that I-frame and generate the I-frame for the trick play information 
stream therefrom. More specifically, the number of AC coefficients for an I— frame of the trick play information signal depends on the 
difference between the DC coefficients of two subsequent I-frames in the normal play information from which the I-frame to be generated 
the just previously generated I-frame for the trick play information signal have been derived. 





I P P 


I P P 


I P P 


I P P 


I P P 


i ! 




i 










Tune 


Trick play speed + 24 y 












I P P 


I P P 


I P P 


I P P 


I P P 





Time 




-'L. WO 9965239A2 I > 



FOR THE PURPOSES OF INFORMATION ONLY 
Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


SZ 


fyu/pTilqnrf 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IK 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


EL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


uz 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


a 


Cote d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


FT 


Portugal 






CU 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






CZ 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







BNSDOC1D: <WO. 



9965239A2_1_> 



WO 99/65239 1 PCT/IB99/01015 

Trick play signal generation for a digital video recorder. 



The invention relates to an apparatus recording a digital video information 
signal and a corresponding trick play signal on a record carrier, said digital video information 
signal being meant for a reproduction from said record carrier at a nominal play reproduction 
speed, said trick play signal being meant for a reproduction from said record carrier at a trick 
5 play speed m times said nominal reproduction speed, m being an integer larger than 1, to a 
method of recording such trick play signal and to a record carrier. 

An apparatus as defined in the opening paragraph is known from published 
international patent application WO 95/28061 (PHN 14832), which corresponds to US-A 
5,751,889. 

10 

Bit rate reduction of digital television signals has been an area of interest for 
over more than three decades. This has resulted in an ISO standard for the coded 
representation of video and associated audio data. The first MPEG publication dated April 

15 1992 which resulted in the introduction of MPEG- 1 . This system was designed to reduce the 
bit rate down to 1.5 Mbits/s. To increase the video quality and still use low bit rates MPEG-2 
has been developed. This technology has been selected to be used in Digital Video 
Broadcasting, (DVB). DVB has the potential to transmit studio quality video at an acceptable 
low bit rate. This enables the customer to receive studio quality at his own place. In order to 

20 enable the customer to store a DVB program with studio quality, a digital video recorder is 
required. Since two years Digital Video (DV) recorders and digital camcorders are available 
for the consumer market. Both systems make use of dedicated video bit rate reduction 
technology which is not compatible with the compression technology that is used in MPEG-2. 
In order to store a selected DVB program and maintaining the high quality, a transparent 

25 recorder is required. Although a standard has been defined to store MPEG on a DV recorder, 
up to now no equipment has been produced that support this standard. A popular consumer 
audio visual storage device is the VHS based video recorder. This system is capable of storing 
and retrieving analog audio visual programs. To enable storage of digital television programs a 
digital extension is currently developed to enable the consumer to store and retrieve DVB 
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programs. The currently developed standard describes the record and playback aspect of this 
system. Not yet included in this standard is how to preform trick play. Trick play based on the 
track select system for D-VHS MPEG-2 STD mode format will be described in this report. 

Since June 1996 a new standard has been released, D-VHS MPEG2 STD mode 
5 format. This digital version of the VHS recorder family is capable of recording DVB signals at 
up to 13.8 Mbits/s. The standard, as it is currently available, only describes the record- and 
play back process. Visual search better know as trick play has not yet been defined. 



10 Proposals for realizing trick play in general, and more specifically for realizing 

trick play for D-VHS MPEG2 STD mode format will be the subject of the present invention. 

In accordance with the invention, the apparatus for recording a digital video 
information signal on a record carrier, the apparatus comprising 

* 

- input means for receiving the digital video information signal, 

15 - trick play signal generating means for generating a trick play signal from said digital video 
information signal, so as to enable a trick play reproduction at a speed m times the nominal 
reproduction speed, where m is an integer larger than 1 , 

- merging means for merging said digital video information signal and said trick play signal 

4 

into a composite information signal, 
20 - writing means for writing said composite information signal in a track on said record carrier, 
said trick play signal generating means being adapted to 

(a) retrieve intra encoded pictures from said digital video information signal, 

(b) generate inter encoded pictures, 

(c) merge said intra encoded pictures and said inter encoded pictures, so as to obtain a trick 
25 play signal comprising subsequent groups of pictures, comprising an intra encoded picture, 

followed by a number of n of said generated inter encoded pictures, where n is an integer 
larger than 0, the generated inter encoded pictures being such that, upon reproduction at said 
trick play speed, an inter encoded picture following an intra encoded picture results, upon 
decoding, in a repeated presentation of a picture obtained from decoding said intra encoded 
30 picture. 

The intra encoded pictures could be in the form of intraframe encoded pictures, 
or in the form of intra field encoded pictures. Further, inter encoded pictures could be in the 
form of interframe encoded pictures, or in the form of interfield encoded pictures. In the 
following description, it will be assumed that the intra encoded pictures are in the form of intra 
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frame encoded pictures and that the inter encoded pictures are in the form of interframe _ 
encoded pictures. 

The invention is based on the following recognition. The generation of the trick 
play information signal is based on the retrieval of intra frame encoded pictures, such as I 
pictures in accordance with the MPEG format, from the normal play information signal. 
Simply using intra frame encoded pictures (I-pictures) with an acceptable refresh rate in the 
trick play information signal is not possible, as the bandwidth available for the transmission of 
those intra frame encoded pictures in the trick play information signal is too small. In order to 
overcome this, so-called 'empty' interframe encoded pictures, such as 'empty* P-pictures, 
and/or 'empty' B pictures, are generated and the datastream of the trick play information signal 
is built up of GOPs, each GOP comprising an intra frame encoded picture (I picture) and one 
or more of those 'empty interframe encoded pictures' (eg. empty P-pictures). Such 'empty' 
interframe encoded pictures result, upon decoding in the repeated presentation of the intra 
frame encoded picture that preceded the one or more 'empty' interframe encoded pictures/As 
the 'empty* interframe encoded pictures require a relatively low bit content, it has now become 
possible to realize a trick play information signal that realizes upon reproduction and 
subsequent decoding in a trick play reproduction mode in a reproduced video signal with 
pictures having a sufficient frame rate. Further, such a GOP structure (as an example an IPP.... 
GOP structure), a sufficient refresh rate can be obtained. 

A further aspect of the invention is that GOPs are generated for the trick play 
information signal with a constant bitcost. This has the advantage that a trick play GOP can be 

re-used for higher trick play video speeds. 

Another aspect of the invention lies in the generation of the intra frame encoded 
pictures for the trick play information signal from the information comprised in the normal 
play information signal. More specifically, an intra frame encoded picture comprises a DC 
coefficient and a number of AC coefficients. The DC coefficients of the subpictures of an intra 
frame encoded picture in the normal play information signal are retrieved therefrom and used 
in the trick play information signal as the DC coefficients of the corresponding subpictures of 
an intra frame encoded picture in said trick play information signal. Further, from a subpicture 
of the same intraframe encoded picture of the normal play information signal, a restricted 
number of AC coefficients from that picture is retrieved to form the AC coefficients for the 
corresponding subpicture of the intraframe encoded picture in the trick play information signal 
to be generated. This results in a reduction of the number of bits in the intra frame encoded 
picture generated, compared to the intraframe encoded picture of the normal play information 
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signal. The number of AC coefficients selected for a subpicture of a specific intrafxame 
encoded picture of the trick play signal depends on the difference between two DC 
coefficients, those DC coefficients being the DC coefficient of the said subpicture and the 
previous subpicture of the specific intraframe encoded picture in the trick play signal. 

The signal processing aspects of low-end trick play will be described. Low-end 
trick play means a trick play signal processing algorithm that re-uses pre-encoded MPEG 
video material to create video trick play. 

The video trick play signal processing in accordance with the invention results 
in a low hardware complexity. For the video trick play signal processing a wide variety of 
architectures can be applied. For all those architectures two main parameters can be used to 
control the final quality. The first parameter is the spatial resolution of the MPEG encoded 
picture. The second parameter is the temporal refresh rate at which the viewer perceives the 
decoded pictures. The low-end video trick play signal processing algorithm, will be based on 
MPEG pre-encoded video information, as it is available in case of a DVB broadcast. Beside a 
wide variety of trick play signal processing algorithms, there is also some variety in the system 
used to implement trick play. The trick play system used in this report is based on track select. 



These and other aspects of the invention will be apparent from and elucidated 
further with reference to the embodiments described hereafter. In the figure description shows 

figure 1 in figure 1 a a top view of a rotary scanner with two heads A and B and 
in figure lb the tracks on tape with different azimuth, 

figure 2 depicts the scan paths of the heads during reproduction, where figure 
2a shows the scan path during normal play and figure 2b shows the scan path for trick play 
with speed equal to four times normal play 

figure 3 shows the contents of two consecutive sync blocks, 

figure 4 shows the relation between PAT and PMT packet, 

figure 5 shows the temporal sub-sampling of a PCM video sequence, where 
figure 5a shows the pictures that form the normal play video in PCM format, figure 5b shows 
trick play with a speed of +4 on the PCM pictures and figure 5c shows the pictures that form 
video trick play with a trick play speed of +4 times the normal play speed, 

figure 6 shows the temporal sub-sampling of an MPEG encoded video sequence 
with a GOP length N=12 and M=4, where figure 6a shows the normal play video in MPEG 



9965239A2 I > 



WO 99/65239 PCT/IB99/01015 

5 

format, figure 6b shows trick play with a speed of +4 on the MPEG pictures and figure 6c _ 
shows the video trick play with a trick play speed of +4 times the normal play speed, 

figure 7 shows the temporal sub-sampling of a MPEG encoded video sequence 
with a GOP length N 1 2 and M^3. where figure 7a shows the normal play video in MPEG 
format, figure 7b sho* % ihc tnck play on MPEG pictures and figure 7c shows the trick play 
video with speed is ■+ 4 times normal play speed, 

figure 8 shows the scan pattern of DCT blocks within a slice, 

figure 9 shows the filling degree of the transcoder I-frame buffer, 

figure 10 shows the flowchart for the I-frame transcoding buffer regulation, 

figure 1 1 indicates the relation between the pictures for the different trick play 

tape speeds, 

figure 12 shows the extraction trick play information for higher video trick play 

speeds from the trick play signal for the +4 times trick play speed, 

figure 13 shows the generation of the trick play information for a reverse trick 

play speed by swapping the GOP of the forward trick play speed, 

figure 14 shows the GOP layout at transport stream level, 

figure 15 shows a block diagram of the trick play signal processing, 

figure 16 shows the decoding and presentation time stamps for 25 Hz frame rate 

on the system time axis, 

figure 17 shows in figure 17a a transport stream without jitter on a PCR packet 

and in figure 17b a transport stream which has jitter on a PCR packet, 

figure 18 shows the manipulation of distance of succeeding transport stream 

packets, and 

figure 19 shows the recording apparatus in accordance with the invention. 

In the following figure description, the invention will be described in the form 
of an example where the intra frame encoded pictures are in the form of I pictures as encoded 
in accordance with the MPEG encoding standard, and where the interframe encoded pictures 
are in the form of P pictures as encoded in accordance with the MPEG encoding standard. 

The general principles of track select trick play will be first described. D-VHS, 
like its analog counter part, is a helical scan recorder. This means that the information is 
written on tape by means of a scanner which is positioned under a angle with respect to the 
longitudinal direction of the tape. The D-VHS scanner used for the MPEG-2 STD mode has 
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two heads A and B with different azimuth. Figure la indicates the position of the two heads A 
and B positioned on a rotary scanner and figure lb shows the tracks with different azimuth on 
tape, obtained during recording, using the above head configuration. 

During normal play reproduction, those two heads read information from tape 
in such a way, that head A read the tracks written with head A during recording. The same 
procedure is valid for head B. During trick play reproduction, the heads A and B have a 
different scan path with respect to the normal play situation. As a consequence, head A and 
head B crosses tracks that have been written with a different azimuth and tracks that have been 
written with the right azimuth when compared to the azimuth of the heads themselves. Figure 
2 depicts the above described phenomenon, where figure 2a shows the scan path during 
normal play and figure 2b shows the scan path for trick play with speed equal to four times 
normal play. 

Track select trick play is based on the fact that head A and B crosses pre- 
determined tracks. When such a system is realized, then it is possible to write information on 
tape in such a way that this data becomes visible during trick play . .Consequence of this system 
is that this data can only be used for one trick play tape speed. For this reason specific trick 
play areas are defined for different trick play speeds. A tape format which contains trick play 
areas that are defined to implement the trick play speeds +/- 4, +/- 12 and +/- 24 times normal 
play speed is described in earlier filed patent applications of applicant, such as US ser. no. 
09/13547 (PHN 16211), which corresponds to international patent application IB 98/00088, 
and international patent application IB 98/00131 (PHN 16614). With the above defined trick 
play speeds, it can be concluded that the values m, p and q, as defined in the claims, equal 4, 3 

and 2, in the present example. 

The burst length of the trick play areas determines the amount of data that can 
be stored within these areas. The tape format, described in the above mentioned patent 
applications, indicates that the amount of data, that is read during one revolution of the 
scanner, is equal for each trick play speed. The amount of data that will be retrieved, during 
one revolution of the scanner, from tape is 1 12 syncblocks, as described in IB 98/00131 . Ten 
syncblocks will contain the outer parities of a second error correction layer, which leaves 102 
syncblocks to carry payload. A syncblock is the smallest unit that is written to tape. It has a 
fixed length of 1 12 bytes. Two consecutive syncblocks will be used to store one transport 
stream packet, so 51 transport stream packets are stored per revolution. The 1 12 bytes are not 
only used to store payload, some of the bytes contains system information and other bytes 
contain inner parity bytes which are generated during record, and can be used by play back to 
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correct erroneous syncblocks. A part of the system information is necessary to distinguish _ 
between normal play syncblocks, dummy syncblocks (stuffing) and trick play syncblocks 
whereby even a distinction is made for the different trick play speeds. For each syncblock, this 
information is written in the main header. The first syncblock contains beside the first part of a 

5 transport stream packet, also contains a timestamp value, the packet header. This is a four byte 
field where information is stored which is necessary for the play back side of the system in 
order to reconstruct the original timing of the successive transport stream packets. Figure 3 
shows the two consecutive syncblocks that carry one transport stream packet. 

From the amount of payload syncblocks that are read per revolution, the 

10 channel bit rate can be calculated. D-VHS MPEG-2 STD mode supports two scanner 
revolutions. The first scanner revolution is 30 Hz, the second scanner revolution is 
30*(1000/1001) = 29,97 Hz. For both situations, the channel bit rate has been calculated and is 
available in table 1 . 



Scanner revolution 


Trick play channel bit rate (bits/s) 


30 Hz 


2301120 


29,97 Hz 


2298821.17 



Table 1 : Channel bit rate for 30 Hz and 29,97 Hz drum frequency. 



The bit rates from table 1 .0 are the maximum bit rates that can be used to generate a video 

20 trick play stream at transport stream level. 

The MPEG compressed video trick play information will be embedded in a 
transport stream which must fit in the trick play bandwidth as calculated above. In order to 
generate video trick play based on the normal play video information, the pictures must be 
extracted from the normal play video stream. The description below will deal with the 

25 different processing steps required to generate trick play from a received DVB stream. The 
two main processing steps are: 

■ Transport stream demultiplexing 
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■ Video elementary stream processing - 

The multiplex operation which converts the video elementary stream back to a transport 
stream will be discussed in chapter three. The reason for this is that the transport layer only 
5 consumes a part of the bu rate, and docs not add anything to the video quality. In this chapter, 
the main focus will be put on how to obtain the best performance with respect to the spatial 

resolution and the temporal refresh rate. 

Audio visual information that is broadcasted by DVB, makes use of a transport 
stream layer. This layer is configurated in such a way that packets, with a fixed length of 188 
10 bytes, carry beside audio visual information also data like videotext and Program Specific 

Information (PSI) from the provider to the end-user. For the transmission three standards have 

been defined: 

■ DVB-S 

■ DVB-C 
15 ■ DVB-T 

the extension S, C and T stands for Satellite, Cable and Terrestrial respectively. Each 
transmission layer is optimized conform its own channel. At the decoder side, the output of the 
channel decoder is a transport stream. Normally this transport stream carries N programs. 

20 After selecting one or more programs, which selection is necessary because the recording 
channel rate is lower than the transmission channel rate of the transport stream, a recording 
operation is possible. In order to generate video trick play based on the recorded program, 
special signal processing is required. The first step is to extract the video elementary stream 
out of the transport stream multiplex. This operation is done by the demultiplexer. 

25 Video data that is transported in a transport stream, is multiplexed together with 

other information such as audio, videotext and PSI. At the receiver side, a program is 
demultiplexed in such a way that all the data of the same type such as video, audio etc are 
separated from the multiplexed stream. The way to demultiplex program information, is 
carried in the transport stream. Two tables, Program Association Table (PAT) and Program 

30 Map Table (PMT) carry information which enables a transport stream decoder to retrieve all 
the information for one program from the multiplexed transport stream. This process is 
described in detail in ISO/IEC 13818-1. After retrieving the video data from the multiplexed 
transport stream, elementary stream processing can be performed on the extracted video 
elementary stream. Figure 4 shows the relation between the PAT and the PMT packet 
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respectively. The PAT packet contains all the available programs in the multiplexed transport 
stream. Each program number has an associated program map PID. This program map PID 
refers to the PMT packet which contains all the PID values that build up one program. This 
PMT table indicates which packet contains the video information. This is done by means of 
5 the stream type identifier and the corresponding elementary PID value. 

Low-end video trick play is based on re-use of pre-encoded video material. In 
case of DVB programs, this means pre-encoded MPEG video. Video trick play, can be treated 
as a normal play video signal, that is sub-sampled in the temporal direction. Practically this 
means that only some pictures in the temporal direction are of interest. The coarseness of the 
10 sub-sample process, the amount of pictures that are skipped, depends on the trick play speed. 
If a video sequence is available in the PCM domain then the following graphical 
representation can be made. Figure 5 contains three sketches. Figure 5a indicates the pictures 
of a normal play stream on the time axis. Figure 5b shows the same time axis as in figure 5a 
whereby the pictures that form the video contents of a trick play video sequence, with a speed 
1 5 of four times normal play speed, are dark coloured, while the pictures that are skipped are 

transparent. Finally figure 5c contains those pictures from a normal play sequence that form a 
trick play sequence which corresponds to four times normal play speed. 

The process depicted in figure 5 can also be performed on MPEG pre-encoded 
video. Figure 6 indicates this process. Figure 6a shows a MPEG encoded normal play video 
20 sequence with N=12 and M=4. Hereby is N the length of a GOP and M is the P-frame 

distance. Figure 6b indicates the sub-sample process for a GOP structure with N=12 and M=4. 
The dark coloured pictures from figure 6b are selected to form the video trick play sequence. 
The transparent pictures are skipped. The filtered pictures form a video trick play sequence, 
see figure 6c. This video sequence does not only contain the pictures that corresponds to the 
25 trick play speed, they even form a valid MPEG stream due to the fact that the motion 
estimation done at the encoder side makes use of the selected pictures. This enables the 
decoder to correctly reconstruct the encoded motion compensated pictures. This last point is 
important because this will normally not be the case. 

Figure 7 indicates the same process but the GOP has a different structure N=12 
30 and M=3. When a video trick play stream is extracted from this GOP structure, whereby the 
filtered pictures corresponds to those that build up a video trick play sequence for four times 
normal play speed, the temporal MPEG reference is corrupted. 

From the previous two examples it can be concluded that only the intra frame 
coded pictures can be re-used for trick play. The reason for this statement is two fold. First, 
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these frames can be standalone decoded, no future or past picture information is necessary 
Second, the pictures contain beside the interlace effect, no temporal information. The interlace 
effect does only occur, when the original scene is interlaced. If the original video scene is 
progressive, for eg. film material, then there is no interlace effect when I-frames are repeated. 

5 The elementary stream video processing has as task, to generate a valid video 

MPEG elementary stream that can be multiplexed into a MPEG transport stream. The video 
clement ar> stream has two main parameters that must meet specific requirements. The first 
parameter is the ov eral! bit rate that will be used for the trick play video elementary stream. 
The sevfiiJ px-amctcr is the frame rate of the video elementary stream. This last parameter 

10 depend, on the comment where the trick play stream is generated. A distinction can be made 
bctu ccn comments that support 25 Hz frame rate and those that use 29,29 Hz or 30 Hz frame 
rate. 

It has been stated before that for video trick play based on video extraction from 
a MPEG pre-encoded program, only the intra frame encoded pictures can be used. The bit cost 
15 of the intra frame encoded pictures depend, beside the size of the picture, strongly on the 
overall bit rate, that has been used to encode the normal play video elementary stream 
sequence. For the video elementary stream bit rate a simple expression can be used, that 
defines the relation between the video elementary stream bit rate and the bit cost per picture. 
In case of a fixed bit cost per picture the overall bit rate will be equal to equation 1. 



20 



Video bitrate - frame rate . frame bitcost (1) 



An MPEG encoded video sequence will normally not have a fixed bit cost per 
picture. Intra frame encoded pictures will have a bit cost that is larger than the bit cost that is 
25 used for motion compensated pictures, such as P- and B pictures. In general MPEG intra frame 
encoded picture requires a transmission time that is larger than one display frame period. For 
typical I-frame bit cost values see table 2, and table 3 for the required transmission times. For 
encoding parameters see table 4. 
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Normal play video 
sequence 



HARLEY 



BARB WIRE 



NEDERLAND-2 



GIRLS 



Average I-frame 
bit cost. (Bits) 



770.084 



281.126 



417.819 



578.032 



Minimum I-frame 
bit cost. (Bits) 



430.896 



45.984 



68.344 



451.616 



Maximum I-frame 
bit cost. (Bits) 



1 .099.696 



564.568 



640.244 



909.848 



sequences. 



Table 2: Typical I-frame bit cost value found in normal play video 



These values depend heavily on: 

■ The used MPEG encoder 

■ The used GOP structure 

■ The used picture size 



Normal play video 
sequence 



HARLEY 



BARB WIRE 



NEDERLAND-2 



GIRLS 



Average I-frame 
Transmission time 
(ms) 



81.9 



82.6 



83.5 



72.2 



Minimum I-frame 
Transmission time 
(ms) 



45.8 



13.5 



13.6 



56.4 



Maximum I-frame 
Transmission time 
(ms) 



116.9 



166.0 



128.0 



113.7 
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Table 3: Typical normal play I-frame transmission times. 



Video sequence: 



HARLEY 



BARB WIRE 



NEDERLAND-2 



GIRLS 



Normal play video sequence 
encoding parameters 



GOP parameters 



M 



1 



N 



12 



12 



12 



12 



Bit rate 
Mbits/s 



9.4 



3.4 



5.0 



8.0 



Amount 
of pels 
per line 



Amount 
of lines 
per frame 



720 



528 



544 



720 



576 



576 



576 



576 



Table 4: Encoding parameters for the video sequences: Harley, Barbwire, 



Nederland-2 and Girls. 



With aid of the values from table 2, some rough calculations can be preformed 
10 on the average bit rates per I-frame for a GOP structure N=l . Table 5 contains the 

transmission bit rates for the I-frames from table 2. From the values depicted in table 5, it 
should become clear, that generating a video trick play sequence with a GOP containing only 
the selected I-frame, and maintaining a frame rate of 25 Hz, requires a high trick play channel 
bit rate. Due to the fact, that intra frame encoded pictures are selected from the normal play 
1 5 video sequence, the peek bit rate will requires huge channel bit rates values, except for the 
BARBWIRE video sequence, and in some cases the required bandwidth is even higher than 
the maximum bit rate allowed in some MPEG applications. For this reason video trick play 
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based on I-frame extraction will not be possible without extra signal processing. There are 
some methods that can be used to reduce the bandwidth problem and still obey the frame rate 
constrain. 

A method that is relatively cheap to implement, is to insert so called empty P- 
frames. Empty P-frame are pictures that force the decoder to display an exact copy of the 
previous decoded picture. Because no extra information is required by the decoder, the P- 
frame must only transmit the minimum MPEG requirements, which means that only the first 
and the last macro block of a slice needs to be transmitted. As a result the empty P-frame bit 
cost is very small. This signal processing step lowers the perceived refresh rate, but creates 
transmission time for the relative large I-frames. Disadvantage of this method is, that the 
picture refresh rate will be reduced, whereby the picture refresh rate can be reduced up to one 
picture per second, but with a spatial resolution equal to that of the original I-frame. A better 
method is to reduce the resolution of each intra frame encoded picture. This method will 
increase the picture refresh rate, but at the same time reduce the spatial picture quality. Beside 
the lower spatial resolution extra hardware complexity is added to the video trick play signal 
processing system. 



Normal play video 
sequence 



HARLEY 



BARB WIRE 



NEDERLAND-2 



GIRLS 



Average video bit 
rate per frame for 25 
Hz frame rate. 
(Bits/s) 



19.252.100 



7.028.150 



10.445.475 



14.450.800 



Minimum video bit 
rate per frame for 
25 Hz frame rate. 
(Bits/s) 



10.772.400 



1.149.600 



1.708.600 



1 1 .290.400 



Maximum video bit 
rate per frame for 
25 Hz frame rate. 



(Bits/s) 



27.492.400 



14.114.200 



16.006.100 



22.746.200 



Table 5: Video elementary stream trick play bit rates, for N=l GOP length, based on I-frame 
selection from a normal play video sequence 
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For trick play based on normal play I-frame selection, some merits can be _ 
defined with respect to hardware implementation. First, some merit parameters of I-frame 
selection from a normal play video sequence for one speed trick play generation will be given. 
Those are: 

5 ■ I-frame can be selected by parsing the video elementary stream on byte basis 

The parser required to extract the I-frame pictures from the normal play stream 
has low complexity, due to the fact that the stream at picture level is byte based. 

10 ■ High spatial quality, equal to the original I-frame resolution. 

Because the selected I-frames are not transcoded, the original spatial resolution 

is maintained. 

15 Next, some demerit parameters of normal play I-frame selection for one speed 

trick play generation will be given. 

■ Low picture refresh rate 

20 Due to large I-frame bit costs and a low bit rate trick play channel, the 

transmission of one compressed intra frame encoded picture requires more than one frame 
display period. Due to this, the picture refresh rate is lower than the frame rate. 

■ Large picture buffer size required for storage of MPEG compressed I-frame. At least one for 
25 each speed. 

Due to the fact, that it requires several display frame periods to transmit the 
extracted I-frame, a buffer is required to store the extracted I-frame. 

30 ■ Perceived trick play speed depends on GOP length. 

The amount of I-frames that can be selected, depends on the GOP length N of 
the normal play video stream. If the I-frame refresh time is larger than the trick play I-frame 
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transmission time, than the trick play picture refresh is determined by the normal play GOP_ 
length N. In worse case situation N is equal to 1023. 

Next, the bitrate reduction by means of lowering the I-frame resolution will be 
described. Video trick play, based on I-frame selection from an MPEG encoded video 

5 elementary stream, will have a bit rate that is larger than the bit rate of the original video 

elementary stream, when the I-frames are used to form a new MPEG video sequence, whereby 
the GOP length N , is equal to one, which means I-frame one. The bit rate of such signals 
varies per picture, and can even be higher than the maximum allowed bit rate as defined within 
some MPEG applications. In the above description, a solution was provided based on insertion 

10 of so called empty P-frames to the video trick play stream in order to lower the required 

channel bit rate. Such a processing works quite well but can considerably lower the picture 
refresh rate, especially when the normal play video stream has a bit rate that is higher than 6 
Mbits/s and has full resolution, this means maximum horizontal- and vertical size. 

1 5 For the generation of video trick play, five parameters are important: 



■ Frame rate 

■ Picture bit cost 

■ Picture refresh rate 
20 ■ Spatial resolution 

The first parameter is a constraint that must be obeyed, and is defined by the 
continent where the recording is performed. The second parameter can be calculated by 
removing the transport stream overhead from the trick play channel bit rate. Only the third 
25 parameter can be modified, which will have a direct influence on the last two parameters. The 
picture refresh rate and the spatial resolution can be treated objectively as well as subjectively. 
Due to the I-frame transcoding, a large part of the picture content is removed. It is for this 
reason that an objective judgement will not be appropriate. A far better method is judgement 

according to subjective criteria. 
30 The only way to increment the picture refresh rate is by lowering the I-frame bit 

cost, this will reduce the required transmission time of an intra frame coded picture. Problem 
by the I-frame bit cost reduction is the fact that an I-frame can not be endlessly reduced. In 
fact, the smallest bit cost is based on the bit cost required to create a spatial resolution whereby 
only the DC value of each DCT block is transmitted. Practically this means that the final bit 
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cost is determined by the sum of all the elementary stream system overhead plus the bits _ 
required to represent the DC value for each DCT block. The elementary stream overhead 
information depends strongly on the picture size. Table 6, contains intra frame transcoded 
pictures with only DC resolution. With aid of these values, the minimum available I-frame bit 
cost that must be available can be calculated. This calculation makes use of the values, which 
are depicted in table 1 and table 6. The video quality obtained with DC only, forms the lowest 
possible quality. Poor is the subjective indication that corresponds to this video quality. 
The trick play channel bit rate from table 1 is used to transmit a video transport stream. 
Because video trick play transport streams contain, beside PSI information, only video 
information, the transport stream overhead can be reduced to 5 % of the total trick play 
channel bit rate. Table 7 contains the available elementary stream video bit rate. 



Normal play video 
sequence 



HARLEY 



Average video bit 
cost (Bits) 



108326 



Minimum video bit 
cost (Bits) 



83600 



Maximum video bit 
cost (Bits) 



122488 



BARBWIRE 



NEDERLAND-2 



GIRLS 



77329 



55012 



78915 



53944 



48032 



75336 



97200 



60176 



81840 



Table 6: Intra frame transcoded pictures containing DC resolution. 



\ 



Scanner revolution 


Trick play video bit rate (bits/s) 


30 Hz 


2186064 


29,97 Hz 


2183880.11 
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Table 7: Elementary video bit rate for 30 Hz and 29,97 Hz drum 

frequency. 

5 The \ ideo elementary stream bit rates that are available in table 7, should be 

used to transmit 25 1 L\ 2*>.97Hz or 30 Hz video. Table 8 contains the bit cost for each frame 
rate, in case of a fix bu cost per picture, 



Frame rate 



30 Hz 



29,97 Hz 



25 Hz 



Picture bit cost (bits) 



72868 



72868 



87442 



10 Table 8: I-frame bit cost, for 25 Hz, 29,97 Hz and 30 Hz frame rate. 

The bit cost per picture, depicted in table 8, is not sufficient to transcode 
selected MPEG-2 encoded I-frames in order to re-use them for trick play. This is caused by the 
fact that the required picture bit cost values are less than the maximum values in table 6. The 

15 only way to make a low-end trick play system work, is by reducing the picture refresh rate. 

Subjectively judged simulations with respect to the minimum required picture 
refresh rate, have shown that a picture should maximally be three times repeated. For a 25 Hz 
frame rate environment this means that the actual picture refresh rate is 8.3 Hz. For the 30 Hz 
and 29.97 Hz frame rate situations, this results in a 10 Hz picture refresh rate. 

20 By reducing the picture refresh rate, the minimum required temporal refresh 

rate is obeyed. Because of the picture refresh reduction of a factor three, the I-frame bit cost is 
almost tripled in size. Only a small part of the I-frame bit cost must be spend on the empty P- 
frame. For 30 Hz and 29,97 Hz frame rate systems the maximum empty P-frame size is 2800 
bits, whereby the 25 Hz frame rate system, the maximum empty P-frame bit cost is 3328 bits. 



BNSDOCID: <WO. 



,9965239A2_L> 



WO 99/65239 



PCT/IB99/01015 



18 



Frame rate 



30 Hz 



29,97 Hz 



25 Hz 



I-frame bit cost (bits) 



218604-5600 = 213004 



218604-5600 = 213004 



262326 - 6656 = 255670 



Table 9. I-frame bit cost, for 25 Hz, 29,97 Hz and 30 Hz frame rate, with a picture refresh 



reduction of a factor 3. 



The calculation to determine the minimum bit cost size for a transcoded I-frame 
with DC resolution is strongly based on the statistic behaviour of natural video. Beside the 

« 

video elementary stream overhead it is strongly determined by the bit cost required to 
represent the DC value of the DCT matrix. 

The video sequences used for the simulations covers a broad range of possible 
bit rates. Not only the bit rate is an important parameter, also the picture format, horizontal- 
and vertical size, of the used video sequences is important. For this reason, the video 
sequences have chosen is such a way, that different picture sizes form part of the normal play 
video analysis. 

In order to transcode an I-frame, two possible transcoding operations could be applied. 

■ Full MPEG decoding up to DCT level, full re-encode at the desired lower bit rate 

■ Selection of runlengthjevel encoded DCT coefficients 

The first method requires high hardware complexity, but will result in an acceptable up to 
good picture quality. The second method requires modest hardware complexity, and will result 
in a poor up to good picture quality. Only the second method, is acceptable in case of low-end 
video trick play. 

Next, the bit cost reduction by means of runlength-level encoded DCT AC 
coefficient selection will be described. 
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As indicated above, a low-end way of reducing the I-frame bit cost, is by means 
of runlength level encoded AC coefficient selection. MPEG makes use of a DCT 
transformation to remove spatial correlation before it is visually weighted quantised, to 
disregard the less important information in a picture. After quantisation the DCT coefficients 

5 are scanned, either zigzag or by means of an alternative scan method, and runlength-level 

encoded. In order to reach the runlength-level encoded DCT coefficients, the video elementary 
stream must be parsed, starting at the picture header all the way down to the block layer. A 
part of this parsing process can be done on byte basis, after the slice header this process must 
be performed by means of variable length decoding see ISO/IEC 13818-2. 

10 The DCT transformation has the advantage that the important energy that build 

up the 8-pels by 8-lines data block is depicted in the upper left corner of the DCT matrix. This 
means that for eg. with aid of the first 20 AC coefficients, the maximum amount of AC 
coefficient per DCT matrix is 63, the most relevant part of the 8-pels by 8-lines data block can 
be reconstructed. A subjective spatial good quality of the picture can be maintained by 

15 transmitting these 20 AC coefficients. When a large number of AC coefficients are removed 
than the spatial subjective quality can no longer be maintained and visible artefacts are 
introduced. This will be the case when for each runlength-level encoded DCT block, only the 
first 2 or 3 AC coefficients are selected and transmitted. The amount of AC coefficients 
available in an I-frame DCT Block, depend strongly on the bit rate at which the original video 

20 sequence is encoded, as well as on the contents of the encoded 8-pels by 8-lines data block. 

By means of experiments the consequence of selecting a certain number of 
lower AC coefficients have been studied. Target of this experiment has been, that the resulting 
video elementary stream bit rate must fit into the D-VHS trick play channel. The picture 
refresh rate has been put at 8.3 Hz and the frame rate is equal to 25 Hz. Tables 10, 1 1 , 12 and 

25 13 contains the results of this study. 
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No. of AC coefficients per 
component type 



U 



V 



Normal play video sequence: HARLEY 



Average bit 
cost 



202015 



219484 



nun 
bit cost 



120392 



130216 



max . 
bit cost 



243144 



267824 



average bit rate 

GOP=EPP 

Mbits/s 



1.751592 



1.897179 



245087 



138264 



305064 



271733 



152944 



341760 



2.111010 



2.333940 



Table 10: AC selection versus I-frame bit cost and average bit rate, seq. HARLEY. 



No. of AC coefficients per 
component type 



15 



18 



20 



U 



10 



12 



15 



10 



12 



15 



Normal play video sequence: BARBWIRE 



Average bit 
cost 



200232 



208029 



214816 



min 


max 


bit cost 


bit cost 


63448 


496664 


65032 


550376 


67424 


579280 



average bit rate 

GOP=IPP 
Mbits/s 



1.735113 



1.796715 



1.858316 
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Table 1 1 : AC selection versus I-frame bit cost and average bit rate, seq. BARB WIRE 



No. of AC coefficients per 



component type 



Y 



10 



r 



10 



v 



10 



Normal play video sequence: NEDERLAND-2 



Average bit 



cost 



237826 



mm 
bit cost 



131856 



max 
bit cost 



237826 



average bit rate 

GOP=IPP 

Mbits/s 



2.058140 



12 



10 



10 



253752 



140688 



318552 



2. 1 86047 



15 



10 



10 



339672 



1 50784 



270292 



2.325582 



Table 12: AC selection versus I-frame bit cost and average bit rate, seq. NEDERLAND-2 



No. of AC coefficients per 
component type 



Normal play video sequence: GIRLS 



8 



10 



U 



8 



8 



Average bit 



cost 



251761 



301307 



334409 



min 
bit cost 



226728 



264992 



294664 



max 
bit cost 



291288 



363648 



412272 



average bit rate 

GOP=IPP 
Mbits/s 



2.200000 



2.600000 



3.000000 
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Table 13: AC selection versus I-frame bit cost and average bit rate, seq. GIRLS 

The video trick play sequence that is generated from those normal play streams 
with N=12 corresponds to a trick play speed, that is equal to four times normal play speed. 
5 Due to the fact, that a temporal picture refresh reduction of a factor three is required in order to 
transmit the transcoded I-frame, all the normal play video GOP structure whereby N=12, will 
lead to the same trick play video sequence. For all the normal play video sequences which 
have a GOP length of N smaller or equal to twelve, the generated trick play sequence has an 
exact relation with respect to the normal play video sequence. This exact relation will not be 
10 maintained when the normal play video sequences have a GOP length greater than twelve. 

The video trick play quality depends strongly on the normal play video bit rate, 
as well as on the picture size. For the I-frame transcoding, the human visual system has been 
taken into account. For this reason the colour difference signals have been transcoded with less 
runlength-level encoded AC coefficients than the luminance signal. 
15 For those normal play video sequences which have a lower horizontal size, such 

as BARB WIRE and NEDERLAND-2, and also have an acceptable bit rate, the achieved 
subjective video quality is ranked acceptable up to good. For the normal play video sequences 
HARLEY and GIRLS, the obtained video trick play quality is ranked poor up to acceptable. 
The reason for this subjective lower video quality is two fold. First, the normal play bit rate is 
20 high, second the horizontal picture size has the maximum values allowed for some MPEG 
applications. 

The subjective quality is strongly influenced by the amount of visible artefacts. 
Two main types of artefacts can be distinguished. First, artefacts due to removing information 
that form fine details. Second, artefacts due to removing information that built up 
25 discontinuities, such as edges, within the spatial area. This last artefact, has a strong influence 
on the subjective judgement of the video trick play sequence. 

From the I-frame transcoding results, the following conclusions can be made. 

30 ■ For normal play MPEG encoded video sequences with bit rates higher than 6 Mbit/s, 

especially for those sequences which have 720 pels per line and 576 lines per frame, strong 
artefacts are introduced because only a few runlength-level encoded AC coefficient can be 
selected, in order to stay within the available bit cost. 
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■ For normal play MPEG encoded video sequences with bit rates less than 6 Mbits/s, more 
runlength level encoded AC coefficients can be selected which reduces considerably the 
amount of clearly visible artefacts. 

5 To reduce the amount of clearly visible artefacts for those situations where 

discontinuities occur in the spatial area, a smart allocation of runlength level encoded AC 
coefficients per DCT block is required. DCT blocks that contain less important information 
require a low number of AC coefficients. Those DCT blocks that contain information that is 
required to reconstruct discontinuities, require a higher number of AC coefficients. 

1 0 This requires knowledge of the picture content of the 8-pels by 8-lines data block in order to 
distinguish DCT blocks which contains discontinuities, and those DCT blocks that contain less 
important information, such as flat areas with no details. 

Next, the differential-dc controlled selection of runlength-level encoded DCT 

AC coefficients will be described. 

15 A uniform assignment of runlength-level encoded AC coefficients for each intra 

frame encoded DCT block leads to a subjective spatial video quality that lies in the range 
between poor up to acceptable when the bit rate of the MPEG-2 encoded video sequence is 
higher than 6 Mbits/s. The following description will deal with a bitcost reduction method that 
can be used to enhance the subjective spatial picture quality for video trick play based on I- 

20 frame extraction from an MPEG-2 pre-encoded video sequence. 

Natural video has temporal as well as spatial correlation. MPEG video 
compression makes use of this correlation to reduce the video bit rate while maintaining a 
subjective good picture quality. For intra frame encoded pictures, the DCT coefficients within 
a given block are almost completely de-correlated. However there is still some correlation 

25 between the coefficients in a given block and the coefficients of neighbouring blocks. This is 
especially true for the block averages represented by the DC coefficients. For this reason, the 
DC coefficient is coded separately from the AC by a predictive DPCM technique. As shown in 
equation 2, the DC value of the neighbouring block just coded (from the same component), P, 
is the prediction for the DC value in the current block. The difference, ADC, is usually close to 
30 zero. 

ADC = DC - P (2) 
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10 



15 



The prediction is determined by the coding order of the blocks in the macro _ 
block. Figure 8 provides a sketch of the coding and prediction sequence. The coding of ADC is 
done by coding a size category and additional bits that specify the precise magnitude and sign. 
The size category determines the number of additional bits required to fully specify the DC 
difference. 

For those situations where there are significant changes in the 8-pels by 8-lines 
data blocks, such as for e.g. at edges, there will be a difference between the two succeeding 
DCT IX" \ alucs. which is not close to zero. The maximum value depends on the amount of 
bits used to encode the DC value. The amount of bits are indicated in the picture coding 
extension For some MPEG applications, the maximum amount of bits used to represent the 
DC magnitude, also known as differential DC, is 10 bits, for luminance as well as for 
chrominance DC sec 1SO/IEC 13818-2 table 8.5, the maximum amount of bits that can be 
allocated for the DC size value is 9 bits for luminance and 10 bits for chrominance. 

With aid of this 10 bits differential DC value, a table can be defined with the 
range of the magnitude DC see table 19. The differential DC value can be used to control the 

AC coefficient assignment process. 

The statistical behaviour of the differential DC value has been studied. For this 
purpose four classes have been defined to determine the statistical character of the differential 
DC value. Table 1 4 contains the defined classes. 



20 



Class one 


Class two 


Class three 


Class four 


differential DC 


0 < differential DC 


5<= differential DC 


differential DC 


value is equal to 0 


value < 5 


value < 15 


value >= 15 



Table 14: Class definition for statistic analysis of the differential DC value 



In order to perform a statistical analysis on a collection of obtained 
measurement results, classes are denned. The class width is normally equal for all the classes. 
For the analysis of the differential DC, a different approach has been made. It has been stated 
before that for normal video sequences there is spatial as well as temporal correlation. For this 
analysis only the spatial correlation is important. Due to this correlation, the differential DC 
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will be small, and perhaps even zero. For this reason, the class definition has been made _ 
according to table 14. Although the range of the differential DC values belongs to the 
collection of integers, the statistic analysis is based at non negative integers, including the 
value zero. This is valid because the range is symmetric, see table 19 and ISO/IEC 13818-2, 
par. 7.2.1. For four MPEG-2 encoded video sequences, a statistical analysis of differential DC 
value has been performed. For this analysis a distinction has been made between the three 
video components Y.U and V. The results of those measurements are available in table 15, 16, 
17 and 18. ~ 



Luminance component Y 



Class 
1 

(%) 



Class 
2 



10 



25 



Class 
3 

(%) 



12 



Class 
4 



19 



Chrominance component U 



Class 
1 

(%) 



Class 
2 



Class 



(%) 



Class 



(%) 



Chrominance component V 



Class 
1 



Class 



(%) 



Class 



Class 
4 



Table 15: Division of differential DC value according to the chosen class definition for video 



sequence HARLEY 



Luminance component Y 



Class 
1 

(%) 



11 



Class 
2 

(%) 



32 



Class 
3 

0, 



16 



Class 
4 

(%) 



8 



Chrominance component U 



Class 
1 



Class 


Class 


2 


3 


(%) 






(%) 


9 


3 



Class 
4 

(%) 



1 



Chrominance component V 



Class 
1 

(%) 



Class 
2 



Class 
3 

'Oy 



Class 
4 

(%) 



0 



15 
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Table 16: Division of differential DC value according to the chosen class definition for video 
sequence GIRLS 



Luminance component Y 



Class 
1 



10 



Class 
2 



28 



Class 
3 

(%) 



14 



Class 



Chrominance component U 



Class 
1 



14 



Class 



10 



Class 



Class 
4 



1 



Chrominance component V 



Class 
1 

(%) 



Class 



10 



Class 
3 



1 



Class 
4 

(%) 



1 



Table 17: Division of differential DC value according to the chosen class definition for video 
sequence NEDERLAND-2 



Luminance component Y 



Class 
1 



Class 



15 



28 



Class 
3 



11 



Class 



(%) 



13 



Chrominance component U 



Class 
1 



Class 



8 



Class 



(%) 



Class 
4 



Chrominance component V 



Class 
1 

(%) 



Class 



Class 
3 



Class 
4 

(%) 



1 



Table 18: Division of differential DC value according to the chosen class definition for video 
sequence BARB WIRE 

An algorithm can be developed that defines how the runlength-level encoded 
AC coefficients can be assigned per DCT block, taking into account the differential DC value 
and its statistical occurrence. Beside the assignment algorithm, a buffer regulation algorithm is 
required in order to prevent a I-frame picture buffer overflow during the transcoding process. 
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Table 19: Variable length codes for differential DC value. 

5 

Next, the assignment of AC coefficients will be further described. The spatial 
resolution of the transcoded I-frame is determined by the number of runlength level encoded 
AC coefficients per DCT block. The bit cost that can be used to transcode the intra frame 
encoded pictures is depicted in table 9. The optimum spatial resolution can be obtained when 
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this bit cost is completely used by the transcoding process. This will lead to a fixed bit costper 
I-frame, because the maximum bit cost is limited in size. A fixed bit cost I-frame together with 
the empty P-frames, which also have a fixed bit cost per picture, results in a fixed bit cost per 
GOP. When the I-frame transcoding process is not optimally performed, than stuffing can be 

5 performed, in order to reach the maximum I-frame bit cost. 

The main task of the transcoding algorithm will be two fold. First, generate a 
spatial resolution that is more ore less constant over the whole screen. Second, the whole 
picture must be transcoded in such a way, that its final bit cost is lower or equal to the 
maximum value depicted in table 9. To obtain a spatial resolution that is equal over the whole 

1 0 screen, the transcoding algorithm must take care that the bit cost per slice is constant. At the 
start of the transcoding process a calculation can be done to define a target slice bit cost. For 
this calculation it is necessary that the elementary stream overhead is known. This overhead 
can vary in size due to the fact that at the encoder side extra information is embedded in the 
video elementary stream. A decoder on the other hand does not need all this information. In 

15 order to perform the decoder process correctly, an elementary stream video decoder only 
requires the following headers and its corresponding extensions. 

■ Sequence header 

■ Sequence extension 
20 ■ GOP header 

■ Picture header 

■ Picture coding extension 

■ Quant matrix extension 

25 Although there are more headers and extensions defined in the ISO/IEC 13818- 

2 standard, these headers and extensions form the minimum required information necessary to 
decode the MPEG encoded video which is the highest profile and level that will be recorded 
by D-VHS MPEG-2 STD mode format. 

During the transcoding process, the received overhead that is minimally 

30 required will be subtracted from the maximum available bit cost. After subtraction, the final 
bit cost remains that can be used for the transcoding process. 

The assignment of the number of runlength-level encoded AC coefficients depends on the 
number of AC coefficients that corresponds to the differential DC value. Because a one time 
initialization of the amount of AC coefficients that will be assigned to a DCT block does not 
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guarantee that the bit cost of the transcoded I-frame is equal or lower than the maximum biL 
cost of table 9, a buffer regulation is required* For the transcoding process two parameters are 
used for the buffer regulation. 

5 ■ Running slice bit cost 

■ Running frame bit cost 

The runnmc slice bit cost, keeps track of the amount of bits used for the current 
transcoded I-frame slice The running frame bit cost, keeps track of the total amount of bits 
10 spend on the up to then transcoded slices. A graphical representation can be made of the buffer 
filling of the I-frame transcoding process, see figure 9. 

The assignment of the AC coefficients per DCT block is a function of the 

differential DC value and depends on 

15 ■ The normal play bit rate 

■ The normal play picture size 

■ The running slice bit cost counter 

■ The running frame bit cost counter 

■ The frame bit cost difference 

20 

The first two parameters, are responsible for the initialization of the I-frame 
transcoder. With aid of these parameters the number of AC coefficients that will be assigned 
per class to a DCT block are defined. For a possible assignment see tables 10, 1 1, 12 and 13. 

A one time initialization will not be sufficient. The assigned number bits per 
25 slice, is not known before hand. This means that afterwards, a check has to be performed to 
see if the assumptions, as they were done during initialization, were correct, figure 10 
indicates a overall flowchart of a possible transcoding buffer regulation process. 

The flowchart contains functions and its corresponding arguments between 
brackets. The corresponding software model contains a precise description the buffer 
30 regulation. The main parameters that are controlled by the buffer regulation are the borders of 
the classes as they where defined for the statistical analysis and the number of AC coefficients 
that will be assigned per DCT block. This action is taken at the bottom of the flowchart by the 
'modify JJi_boarder(....y and , modify_no_ac_coef( )'blocks, respectively. 
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A further way of data compressing the information in a trick play signal, is by 
way of macroblock truncation. Macroblock truncation means that one or more macroblocks in 
each slice of a picture, more specifically, counted from the right hand side of the picture, are 
deleted. A received DVB program has an unknown bitrate as well as an unknown picture size. 
For all possible signal situations, the transcoding process should work properly. Macroblock 
truncation is a possible step that can be applied in critical situations, as data reduction method, 
as well as that it can be used to allows for a better subjective picture quality. 

The main task of the transcoding process is to generate a valid MPEG video 
elementary stream. In a specific application, the maximum number of bits per macroblock is 
4608 bits. If such a stream enters the transcoding system, the chance that a transcoded picture 
fits into the target bitcost, is small. For this situation, macroblock truncation offers the 
possibility to strongly reduce the bitcost of the incoming intraframe encoded pictures. Because 
a picture of one macroblock per slice is a valid picture, the transcoder can give the guarantee 
that under all circumstances a valid video stream can be generated. 

Macroblock truncation can also be used to enhance. the subjective video quality. 
This is done by deleting the last 5 or ten macroblocks or even more of all slices. The bitcost 
that would be used to transcode the deleted right hand portion of the picture, can now be spent 
on the remaining portion of the picture. Due to the fact that the decoder performs an 
upsampling in horizontal direction, the viewer will still have a full screen video. Because 
upsampling in horizontal direction is performed by the decoder, the shape of the objects in the 
spatial area are stretched horizontally. This can become annoying if too may macroblocks are 
deleted. 

Next, the generation of six trick play video signals will be described. 

The example of the track select trick play system described above supports six 
different trick play speeds, +/4, +/- 12 and +/- 24. All those trick play speed have their own 
trick play areas on tape, which form a virtual channel that during record will be filled with a 
video trick play transport stream. In order to prevent the implementation of six different I- 
frame transcoders, re-usability of trick play video will be performed. Re-usability is enabled 
by the fact that a fixed bit cost per GOP is used. The supported trick play speeds have a 
common dividend. The video trick play which corresponds to speed +/- 1 2 and +/- 24 can both 
be deducted from speed +/-4. Figure 1 1 indicates the relation between the pictures for the 

different trick play tape speeds. 

When video trick play information is extracted, from the +/- 4 times video trick 
play speed, in order to generate video trick play for higher tape speed such as +/- 12 and +/- 24 
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respectively, care must be taken to prevent a video elementary stream buffer overflow. This_bit 
buffer must never overflow. This is the responsibility of the MPEG encoder. The video trick 
play transcoder has the function of a MPEG encoder and for this reason carries the 
responsibility not to cause a video bit buffer overflow. Although this point is highly important 
is does not require any special attention. The only stream that is really generated by the video 
transcoder is the video trick play stream that corresponds to four times normal play speed. 
This video elementary stream is conform the MPEG constrains. Due to the fact that a fixed bit 
cost per GOP is used, the video trick play streams extracted from this video stream fulfil 
automatically the MPEG constrains and a buffer overflow is prevented. Figure 12 shows the 
extraction of higher video trick play speeds from the four times video trick play speed in the 
compressed domain. As shown in figure 12, the trick play information signal for the higher 
video trick play speed can be obtained by sub-sampling the trick play information for the 

lowest video trick play speed. 

Next, the generation of a trick play information signal for reverse video trick 
play will be described. The obtained forward video trick play streams can be used to generate 
reverse video trick play as well. In order to generate reverse video trick play the GOP based 
video needs to be swapped. Figure 13 indicates this process. 

Next, a practical implementation of low-end video trick play will be given. In 
the description given above, the video elementary stream processing has been explained in 
order to obtain the best spatial resolution and temporal picture refresh rate. The description 
that follows will provide a practical implementation based on the results from the description 
given above. 

The trick play channel bandwidth that is available for video trick play at 
transport stream level is depicted in table 1. In the earlier description, an assumption has been 
made that the transport stream overhead is 5% of the total bit rate. In the following 
description, the exact transport stream overhead will be calculated. 
For the calculation of the transport stream overhead a distinction can be made between the 
supported frame rates. For D-VHS MPEG-2 STD mode format three different frame rates, 30 
Hz, 29.97 Hz and 25 Hz are supported. Due to the fact that two scanner revolutions, 30 Hz and 
29.97 Hz are supported, the supported frame rates can be depicted at the supported scanner 
rate. Table 20 indicates the supported record modes. 
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Frame rate 


Record and play back scanner rate 


25 Hz 


30 Hz 


30 Hz 


30 Hz 


29.97 Hz 


29.97 Hz 



Table 20: Supported record and play back scanner rate modes 

Table 20 indicates that there is a perfect fit for the 30 Hz frame rate situation 
5 and the 29.97 Hz frame rate situation. Each revolution of the scanner is equal to one display 
period. The GOP length N used for the video trick play elementary stream is equal to three. 
This means that for the 30 Hz frame rate as well as for the 29.97 Hz frame rate the signal is 
periodic with 3 frame periods, or in other words three revolutions of the drum. As a 
consequence of this periodicity and the fact that 5 1 transport stream packets are recorded per 
10 revolution, the video trick play GOP as defined above can be depicted at 153 transport stream 
packets. Because of this situation an exact I-frame bit cost can be calculated. To calculate the 
I-frame bit cost all the required packets to transmit one GOP are depicted in figure 14. Table 
21 indicates the occurrence of each packet type. The smallest period interval to record a 25 Hz 
frame rate corresponds to 18 revolutions. Within this period 15 frames are stored, which is 

15 equal to 5 GOP's. 

With aid of the GOP layout at transport stream level depicted in figure 14, the 

total amount of transport stream overhead can be calculated. In table 21 the amount of 

transport stream overhead is depicted for the three frame rate situations. The characters 

a,b,c,d,e,f,g,h,i j and k in table 21 correspond to the characters used in figure 14. 
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Table 21 indicates the division of the used transport stream packet types at the 
smallest periodic time interval. For the situations where the frame rate is equal to the scanner 
rate a perfect fit of transportstream packets can be reached with respect to the periodicity. The 
situation whereby the frame rate does not fit exactly on the scanner rate, stuffing is performed 
to obtain periodicity. The reason for this lies in the fact that the GOP structure that builds the 
video elementary stream will be fit at a fixed amount of transport stream packets. The packets 
a,b,c,d,e,f,g,h,i and j from figure 14, form the basic GOP structure at transport stream level. 
Packet k is only available after every fifth basic GOP structure. With aid of the basic GOP 
structure at transport stream level the available video elementary stream bandwidth can be 
calculated. In order to calculate the video elementary stream bandwidth, the transport stream 

overhead will be explored. 

Next, the bandwidth of the video elementary stream will be discussed. 

A transport stream consist of packets with a fixed packet length of 1 88 bytes. A 
distinction can be made between packets that contain video information, packets that contain 
video information and PES information, and packets that contain demultiplex information, 
Program Specific Information (PSI). The packets that are depicted in figure 14, contain either 
PSI or video information, or video- and PES information. A special packet is the null packet 
which is used for channel stuffing. The video elementary stream bandwidth can be calculated 
by extracting the non video elementary stream bit rate, from the available channel bit rate. The 
non video elementary stream is defined by the following packets and specific field: 



■ The PAT packet 

■ The PMT packet 

■ The main ts header 

■ The adaptation field 

■ The PES header 

The transport stream overhead is slightly lower than the 5 % assumed earlier. 
Due to this the I-frame bit cost is slightly higher than the values from table 9. 

First, an embodiment with a 30 Hz scanner and 30 Hz frame rate will be 
discussed The channel rate can be defined by multiplying the amount of transportstream 
packet that can be stored per revolution, which is 51, times the amount of revolutions per G 
period, which is three. This results in 153 transportstream packets per 3 revolutions. 
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Subtracting all the non elementary stream data from the 1 53 transportstream packets resultsjn 
a video elementary stream bit rate of 2131920 bits/s. With a GOP structure of IPP, where by 
the P-frame have a fixed bitcost of 350 bytes, 30 slices times 1 1 bytes per slice plus 20 bytes 
for the picture header and picture header extension result in a I-frame bitcost of 207592 bits 
5 per picture. 

Next, an embodiment with a 29.97 Hz scanner and 29.97 Hz frame rate will be 
discussed. The bit rate calculation is almost equal to that of the 30 Hz scanner- and 30 Hz 
frame rate situation. The video elementary stream bit rate is 2129790.209 bits/s. The I-frame 
bitcost is not effected by 0.1% variation so with a GOP structure of IPP, where by the P-frame 
10 have a fixed bitcost of 350 bytes, 30 slices times 1 1 bytes per slice plus 20 bytes for the 
picture header and picture header extension result in a I-frame bitcost of 207592 bits per 
picture. 

Finally, an embodiment with a 30 Hz scanner and 25 Hz frame rate is 

discussed. 

1 5 The calculation for this situation is slightly different with respect to the previous two 

situations. Again the channel rate can be defined by multiplying the amount of transportstream 
packet that can be stored per revolution, which is 51, times the amount of revolutions per GOP 
period, which is 18. This results in 918 transportstream packets per 18 revolutions. Subtracting 
all the non elementary stream data from the 153 transportstream packets result in a video 

20 elementary stream bit rate of 2198266.66 bits/s. With a GOP structure of IPP, where by the P- 
frame have a fixed bitcost of 416 bytes, 36 slices times 1 1 bytes per slice plus 20 bytes for the 
picture header and picture header extension result in a I-frame bitcost of 257136 bits per 
picture. 

Next, the signal processing to generate a valid MPEG transport stream for 
25 recording that comprises a normal play transport stream component and a trick play transport 
stream component, will be described hereafter. 

A block diagram of the required signal processing blocks is depicted in figure 
15. The first signal processing block in figure 15 is the transport stream demultiplexer. This 
block extracts the video elementary stream from the multiplexed transport stream. The 
30 information required to perform this operation is the video PID of the video elementary 

stream. This information can either be obtained by parsing the PSI or can be delivered by other 
parts of the recording system. In case of PSI usage, special packets are parsed to obtain the 
required video PID. The first packet that is parsed is the PAT packet which has PID ^O'. This 
packet contains the PMT PID. This PMT PID, which is a customer defined value, carries the 
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video PID which is also a customer defined value. For detailed information see figure 4, and, 
ISO/IEC 13818-1. In case that there is only one program available, the generation of video 
trick play is unambiguous. When there are more program such as for e.g. multi camera, then 
an arrangement is required to define on which program trick play is performed. A possible 
5 solution may be that in case of multi program, trick play is generated for the first- or the last 

program in the PAT table. 

After extracting the video elementary stream from the multiplexed transport 
stream. I- frame extraction is carried out. A video decoder can only start decoding when a 
sequence header, in case of MPEG-1, or a sequence header and a sequence extension, in case 

10 of MPLCi is received. For this reason, the sequence header and sequence extension are 
stored in memory. For those situation where a new GOP is not succeeded by a sequence 
header and a sequence extension, the in memory stored sequence header and sequence 
extension are inserted before sending the GOP header. The purpose of this insertion is to 
enable ihc video decoding process to start as quickly as possible after a switch from normal 

15 play to trick play. The stored sequence header and sequence extension header are updated each 
time a sequence header and sequence extension header is received. This is important because 
the quantizer field may have been changed. The other field in the sequence headers must 
remain the same value for the whole video sequence. The next header that should follow the 
sequence layer is the GOP header. All extensions start codes that follow the sequence 

20 extension arc ignored. This is done because they are not required by the video decoding 

process and only consumes bits that are necessary for the transcoding process. After the GOP 
header, the picture header should be received. Extensions that follow this header beside the 
picture coding extension and the quant matrix extension will be ignored. Up to now, all the 
filtering can be done on a byte basis. So far the following headers are parsed and necessary for 

25 the transcoded I-frame. 



■ Sequence header 

■ Sequence extension 

■ GOP header 
30 H Picture header 

■ Picture, coding extension 

■ Quant matrix extension 
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After the quant matrix extension, if available, otherwise after the picture coding 
extension the slices are received. These units contain the compressed video data. Slices can be 
detected by parsing the video elementary stream on byte basis. From here on variable length 
decoding will take place, and the in chapter five described transcoding process is performed. 

5 When the selected I-frame is reduced, a valid elementary stream must be 

obtained. For this reason so called empty P-frames are added to the reduced I-frame in order to 
have the correct frame rate. The P-frame horizontal size depends on the horizontal size of the 
original I-frame size. The amount of variation is limited because the maximum horizontal size 
which is maximal 720 pels in some MPEG applications. An empty P-frame must always 

10 contain the first and last macroblock of a slice, this is required by MPEG. The macroblocks 
that are in between the first and the last macroblock are skipped. This is way such frames are 

called empty P-frames. 

Before the video elementary stream is converted into transport stream packets 
with a length of 188 bytes, a Packet header is added to the individual pictures' that build up the 

15 video elementary stream. The Packetized Elementary Stream (PES) consists of the individual 
pictures that build up the video elementary stream. The only difference is thai a header is 
attached to each compressed picture which carries information such as Decoding Time Stamp 
(DTS), Presentation Time Stamp (PTS), DSM_trick_mode_flag etc. For more details see 
ISO/IEC 13818-1. The DTS controls the video decoding process and the PTS controls the 

20 video presentation process. These two time stamps form the second way to perform the 

decoding process. The first way is by using the VBV^delay that is available in the elementary 
stream picture header. The time base, Program Clock Reference (PCR), which is used for the 
decoding process is transmitted by the transport stream. The DTS and PTS are unique points 
on the PCR time axes. For an example see figure 16 

25 The generation of DTS and PTS can be done by just incrementing the DTS and 

PTS value by one frame period. The example given below described the calculation of this one 
frame period value. 

Example: 

30 Frame period = 40 ms, (25 Hz frame rate) 
System clock = 27 Mhz 

Amount_of_27Mhz_cycles_per_frame__period = (Frame period * System clock ) 

1080000 = 40e-3 * 27e6 



> sWO 996S239A2_I_> 



WO 99/65239 



38 



PCT/IB99/01015 



The DTS and PTS have a resolution based on a 90 Khz clock. For this reason 
the Amount_of_27Mhz_cycles_per_frame_period must be divided by 300. This division 

results in a frame period value of 3600. 

So when three frame period are required to transmit one I-frame and two empty 

P-frames, then the initialisation value for DTS and PTS becomes: 

DTS = 3 * 3600 = 1 0800 
PTS = 4 * 3600 = 14400 

These values are depicted at a 33 bits wide field in the PES header. 

The initialisation value depends on the amount of time that is required to transmit the first 
picture to the decoder. This depends on the VBV_delay and the time consumed, extra delay, 

by the multiplex process. 

The transport stream multiplex operation, multiplexes the packetized video 
elementary stream and the required Program Specific Information (PSI). For this purpose the 
packetized video elementary stream is divided over K transport stream packets. Hereby is K 
the number of packets required to transmit one packetized video elementary stream picture. 
With aid of table 21, the value of K can be calculated for the three supported recording 
situations. 

The transport stream layer takes care of several system aspects. The following 
system aspects are minimally required to create a transport stream that can be decoded by a 
transport stream decoder: 

■ Synchronizes the decoder time base to the encoder time base 

■ Contains a mechanism to deal with corrupted data 

■ Contains a mechanism to deal with time base discontinuities 

■ Indicate a random access points 

Video trick play, regardless the trick play speed, can be seen a video sequence, 
and normally with a finite duration. Such a video sequence has a time base, the temporal 
direction, on which at regular time intervals, usually the frame period, pictures are decoded 
and presented at a display, see figure 1 6. The time base at the decoder side must be locked to 
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that of the encoder in order to prevent a drift of the audio visual information. For video trick 
play there can only occur a drift in the video decoding and presentation process. To lock the 
decoder time base to that of the encoder time base a Program Clock Reference (PCR) is send 
to the decoder at regular time intervals. MPEG as well as DVB have put constraints on this . 
parameter. Table 22 below contains the recommended refresh values for several transport 
stream parameters. 



Parameter name 



PAT 



PMT 



PCR 



According to ETS 290 



Min 



25 ms 



25 ms 



0 ms 



Max 



0.5 s 



0.5 s 



0.04 s 



Table 22: Packet distance for PAT.PMT and PCR packets 

Transport stream packets that are corrupted due to transmission errors can 
disturb the decoding process. They can for e.g. cause a pipeline error in the video elementary 
stream decoder. For the D-VHS system an error correction system is available that is capable 
of correcting most of the errors that occur during the read process. Packets that are corrupted 
and can not be corrected by the error correction system can either be flagged by means of a 
transport_error_indicator, or can be removed from the multiplex. A transport stream decoder 
can disregard packets which transport_error_indicator flag is active, this will increase the 
robustness of the decoder system. The missing video data is replaced by video data from the 
previous decoded picture. This process is known as concealment. 

In situations where there is a switch between normal play and trick play, the 
time base will make a jump. A transport steam decoder will react on such a jump by 
modifying its system clock caused by the PCR value of the new transport stream. This will 
lead to undefined situations in the transport stream decoder. It requires a certain time before 
the decoder will recover from this time base discontinuity and start working properly again. 
This recovery must be initiated by the decoder. This means that the decoder has to monitor its 
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behaviour to detect such situations. In order to prevent this discontinuity, a discontinuity flag 
can be made active each time a switch is made between normal play and trick play or trick 
play and normal play. Beside activating the discontinuity flag the data that refer to the 
previous time base must not arrive at the input of the decoder and the first new data that 
should arrive at the decoders input must contain a random_access_indicator, for detailed 

information see ISO/IEC 13818-1. 

The transport stream will be transported across a medium (e.g a record carrier). 
The delay of this medium must be equal for each transport stream packet. If this is not the case 
than it is possible to corrupt the decoding time base. This is caused by the fact that some 
transport stream packets which contain the PCR value will take more time to arrive at the 
transport stream decoder input. The time sample taken at the encoder side, the PCR value, will 
be used in the decoder to synchronize the local decoder time base. An extra transmission delay 
will cause jitter on the 27 MHz decoder clock. The maximum jitter that is allowed is defined 
by the ISO/IEC 13838-1, 2.4.2.1. Figure 17 indicates this process. 

The distance in time between two succeeding transport stream packets that 
contain a PCR value, should be fixed. This means that the -time which can be calculated with 
aid of the PCR value in the two PCR packets, and the time elapsed by the transmission should 
be equal. For the situation as depicted in figure 1 7a, the elapsed time should be 40 ms. The 
situation is figure 17b can cause problems if the -time is large enough and fall outside the 

allowed j itter range. 

A storage device can also be treated as a transmission channel. If only a 
recording is performed, then the delay is infinite. This will normally not be the case. At play 
back, the timing between succeeding transport stream packets must be in such a way 
reconstructed that it becomes equal to the timing between succeeding transport stream packets 
as they arrived at the input of the storage device during record. For this purpose a process 

called time stamping is performed. 

Normal play time stamping in D-VHS, is a mechanism that attaches a time label 
based on the 27 Mhz clock which is locked to the incoming transport stream, to each incoming 
transport stream packet. The time label is referenced to the time duration of one revolution, in 
case of trick play, or three revolutions, in case of normal play, of the drum. During play back 
the timing between succeeding transport stream packets can be reconstructed with aid of this 
time label. Once a time label is attached to a transport stream packet, this packet can be 
manipulated in various ways. One important aspect of this manipulation is that the position, of 
a transport stream packet may be changed. Figurel 8 indicates this manipulation. Changing the 
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position does not mean the order in which should arrive at the decoder input. A manipulation 
such as depicted in figurel 8, occurs for example when the incoming transport stream has 
temporarily a higher bit rate than the D-VHS channel bit rate. Packets will be smoothed in 
time in order to store them on tape. Another situation occurs when trick play is added to the 
tape format. When there ts no tnck play, the normal play transport stream packets will be 
stored on a position within the tracks corresponding to the calculated position. This calculation 
is done with aid of the attached time stamp, see D-VHS system standard paragraph 2.4.2.1 and 
2.4.3 for details. When this calculated position is not free in e.g. when it is occupied by trick 
play data, than the normal play transport stream packet is shifted to the first free syncblock 

area. 

Due to the attached time stamp value, the original timing of the transport stream 

can be obtained during play back. 

For trick play there is also a time stamp mechanism. The mechanism works 
exactly the same as in normal play. Reference is made in this respect to earlier filed 
international patent application IB98/0013 1 (PHN 16614) for details. The difference between 
the trick play transport stream and the normal play transport stream is that the normal play 
stream can be a fixed bit rate stream and that the trick play stream is a fixed bit rate stream, 
when generated in the way described above. A fixed bit rate is defined as a transport stream 
whereby the transport stream packets have a equidistant distance on the time axis. In a variable 
bit rate transport stream, succeeding transport stream do not have a equidistant distance on the 
time axis. Because there are 51 transport stream packets read during one revolution of the 
scanner during trick play, time stamping becomes a simple process. For the software generated 
trick play transport stream, which is not a real time process, time stamps can be calculated by 
means of linear interpolation. The PCR values in the transport stream which contain samples 
of the real time 27Mhz encoder clock, can be used to generate the time stamps required for 
trick play transport stream recording. Linear interpolation does not only deliver the exact time 
stamp values for those transport stream packets that contain the PCR fields, but also for the 
transport stream packets that lay in between the two PCR packets. This last phenomenon is 
caused by the fact that the transport stream has a fixed bit rate whereby the transport stream 

packets have a equidistant distance. 

The following can be concluded. Low-end video trick play based on the track 
select system has the potential of providing a subjective video quality that can be ranked from 
acceptable up to good. The trick play signal processing algorithm is a transcoding algorithm, 
based on selecting runlength-level encoded AC coefficients from selected normal play intra 
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frame MPEG encoded pictures. To suppress the amount of clearly visible artefacts, that occur 
when only a small number of AC coefficient per DCT block are selected, the AC coefficient 
selection process depends on the value of the differential DC of that DCT block. This method 
will reduce the amount of visible artefacts that occur at edges. 

Although the amount of intra frame encoded pictures that can be transmitted to 
the receiver side is smaller than the supported frame rate a normal transport stream decoder 
can be used to display the decoded video trick play stream. Key factor hereby is the so called 
empty P-frame. With aid of such a picture', a valid MPEG video elementary stream (valid, 
with respect to the frame rate) can be generated. This is important because all the provisions 
that are available to take over the video decoder control are a manufacturer's option. This 
means that there is no guarantee that a decoder control can be realized. Trick play based on 
repetition of intra frame pictures may lead to interlace disturbance. Such a situation will occur 
when the original video was not progressively scanned. With the aid of flags in the transport 
stream layer the video decoder can be forced into field repeat mode. But again this is a 
manufacturer's option. Trick play, based on I-frame selection, offers the advantage that the 
generated video trick play stream can be used for reverse trick play as well due to the fact that 
beside the interlace information there is no temporal information in the video information. By 
means of temporal sub-sampling in the MPEG compressed domain, high video trick play 
stream can be generated. Due to the re-usability of transcoded video trick play data there will 
only be one video transcoder to generate all the required video elementary trick play streams. 

Normal play channel stuffing is based on insertion of dummy syncblocks. Trick 
play channel stuffing based on syncblock stuffing makes trick play generation for reverse 
speeds unnecessarily complex. For this reason trick play channel stuffing based on dummy 
syncblocks has been abandoned and transport stream stuffing is introduced. Although 
transport stream stuffing requires two syncblocks, the trick play system complexity is reduced 
considerably. Due to the fact that two of the three supported frame rates can be mapped at the 
scanner rate, channel stuffing only occurs for the 25 Hz frame rate. 

Due to a fixed trick play transport stream mapping, time stamping becomes a 

signal processing step with less complexity. 

Next, an apparatus of the helical scan type, for recording the trick play 
information on a longitudinal record carrier, is described. Figure 19 shows the recording 
apparatus which comprises an input terminal 1 1 1 for receiving a video signal and a 
corresponding audio signal. The video signal and the corresponding audio signal may have 
been encoded into transport packets included in an MPEG serial datastream, well known in the 
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art. The input terminal 1 1 1 is coupled to an input 1 1 2 of a 'normal play' processing unit 1 1 4. 
Further, a 'trick play' processing unit 1 1 6 is provided having an input 1 1 7 also coupled to the 
input terminal 111. Outputs 119 and 120 of the 'normal play' processing unit 1 14 and the 'trick 
play' processing unit 1 16 are coupled to corresponding inputs of a multiplexer 122. The 
5 -normal play' information as well as the 'trick play information will be recorded in the tracks 

on the record carrier 140. 

For a further description of the 'normal play' processing unit 1 14 and the 'trick 

play' processing unit 1 16, reference is made to EP-A 702,877 (PHN 14.818). 

A subcode signal generator 124 is present for supplying the subcode signal 
10 information for storage in a subcode signal recording portion in the tracks on the record 
carrier. Outputs of the multiplexer 122 and the generator 124 are coupled to corresponding 
inputs of an error correction encoder unit 126. The error correction encoder unit 126 is capable 
of carrying out a error correction encoding step on the 'normal play' (video and audio) 
information and the trick play information, so as to obtain the parity information. 
15 The recording apparatus further comprises a generator 130 for adding sync and 

ID information. After combination of the signals in the combining unit 132, the combined 
signal is applied to a unit 134, in which a channel encoding is carried out on the composite 
signal The channel encoding carried out in the encoding unit 134 is well known in the art. For 
an example of such channel coding, reference is made in this respect to US-A 5,142,421 (PHN 

20 13.537). 

An output of the channel encoding unit 134 is coupled to an input of a writing 
unit 136 in which the datastream obtained with the encoding unit 134 is recorded in the slant 
tracks on a record carrier 140, by means of at least two write heads 142 and 144 positioned on 
a rotating head drum 146. The write heads 142 and 144 have head gaps with a mutually 
25 different azimuth angle. Further, a time stamp generator 147 is available for generating the 
time stamps for the normal play processing unit 1 14 and the trick play processing unit 1 16. 

A microprocessor unit 148 is present for controlling the functioning of the 

various blocks, such as: 

- the control of the normal play signal processing block 1 14 via the control connection 150, 
30 - the control of the trick play signal processing block 1 16 via the control connection 152, 

- the control of the subcode signal generator block 124 via the control connection 154, 

- the control of the error correction encoding block 126 via the control connection 156, 

- the control of the sync signal and ID signal generator block 130 via the control connection 
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- the control of the channel encoding block 134 via the control connection 160, 

- the control of the transport velocity of the record carrier 140 and the rotation of the head 
drum 146, via the control connection 162, and 

- the control of the time stamp generator 147 via the control connection 164. 

The tnck play processing 1 16 is adapted to retrieve I-frame information from 
the first information signal, in the way described above. The trick play signal obtained for a 
specific trick play speed is accommodated in trick play sync blocks, for recording on the 
record carrier. 

Further, for each trick play information signal, trick play sync blocks are 
generated, in the sense that for each trick play sync block, a trick play speed identifier and a 
direction identifier are generated and stored in the trick play sync block and a time stamp is 
added to each packet in the various trick play information signals. 

Next, the trick play sync blocks and the 'normal play' sync blocks, generated by 
the normal play signal processing unit 1 14, are combined in the multiplexer unit 122. Subcode 
data is added and an error correction encoding is carried out on the combined normal play data 
and trick play data so as to obtain the parity information. Further, sync words and 
identification information is added. Next, a channel encoding step is carried out on the 
information prior to recording the information in the tracks. 

Whilst the invention has been described with reference to preferred 
embodiments thereof, it is to be understood that these are not limitative examples. Thus, 
various modifications may become apparent to those skilled in the art, without departing from 
the scope of the invention, as defined by the claims. 

Further, the invention lies in each and every novel feature or combination of 

features. 
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CLAIMS: 



I Apparatus for recording a digital video information signal on a record carrier, 

the apparatus comprising 

. input means for receiving the digital video information signal, 

- tncL pij> m.ctjI generating means for generating a trick play signal from said digital video 
5 inform at ion si irna! . so as to enable a trick play reproduction at a speed m times the nominal 

reproduction speed, where m is an integer larger than 1, 

- merging means for merging said digital video information signal and said trick play signal 
into a composite information signal, 

- writing means for writing said composite information signal in a track on said record carrier, 
10 said tnck play signal generating means being adapted to 

(a) retrieve intra encoded pictures from said digital video information signal, 

(b) generate inter encoded pictures, 

(c) merge said intra encoded pictures and said inter encoded pictures, so as to obtain a trick 
play signal comprising subsequent groups of pictures, comprising an intra encoded picture, 

1 5 followed by a number of n of said generated inter encoded pictures, where n is an integer 

larger than 0, the generated inter encoded pictures being such that, upon reproduction at said 
trick play speed, an inter encoded picture following an intra encoded picture results, upon 
decoding, in a repeated presentation of a picture obtained from decoding said intra encoded 
picture. 



20 



25 



2. Apparatus as claimed in claim 1 , wherein an inter encoded picture in said group 
of pictures has been obtained by an encoding step which is equivalent to encoding a picture 
which is a copy of the previous picture in the said group of pictures that led to the intra 
encoded picture in said group of pictures. 

3. Apparatus as claimed in claim 1 or 2, wherein the apparatus is further adapted 
to record a second trick play signal on said record carrier, said second trick play signal being 
meant for a reproduction from said record carrier at a second trick play speed p . m times said 
nominal reproduction speed, p being a constant larger than 1, said trick play signal generating 
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means further being adapted to generate said second trick play signal from said video 
information signal by selecting each p-th group of pictures from the first mentioned trick play 
signal, said merging means being further adapted to merge said second trick play signal into 
said composite signal. 

5 

4. Apparatus as claimed in claim 3, wherein the apparatus is further adapted to 

record a third trick play signal on said record carrier, said third trick play signal being meant 
for a reproduction from said record carrier at a third trick play speed p . m . q times said 
nominal reproduction speed, q being a constant larger than 1, said trick play signal generating 
1 0 means further being adapted to generate said third trick play signal from said video 

information signal by selecting each q-th group of pictures from the second trick play signal, 
said merging means being further adapted to merge said third trick play signal into said 
composite signal. 

15 5 Apparatus as claimed in claim 1 or 2, wherein the apparatus is further adapted 

to record a second trick play signal on said record carrier, said second trick play signal being 
meant for a reproduction from said record carrier at a second trick play speed - m times said 
nominal reproduction speed, said trick play signal generating means further being adapted to 
generate said second trick play signal from said video information signal by reversing the 

20 sequence of pictures in each group of pictures in the first mentioned trick play signal, said 
merging means being further adapted to merge said second trick play signal into said 
composite signal. 

6. Apparatus as claimed in claim 1 or 2, wherein said trick play signal generating 
25 means is adapted to generate said groups of pictures in said trick play signal such that they all 

have a constant bit cost. 

7. Apparatus as claimed in claim 1 or 2, wherein said intra encoded pictures in 
said trick play signal are data compressed versions of intra encoded pictures comprised in said 

30 digital video information signal. 

8. Apparatus as claimed in claim 7, wherein said trick play signal generating 
means is adapted to data compress intra encoded pictures comprised in said digital video 
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information signal by lowering the resolution of said intra encoded pictures so as to obtain said 
intra encoded pictures of said trick play signal. 

9 # Apparatus as claimed in claim 7, wherein said trick play signal generating 

means is adapted to data compress intra encoded pictures comprised in said digital video 
information signal by selecting a restricted number of AC coefficients of said intra encoded 
pictures so as to obtain said intra encoded pictures of said trick play signal. 

10. Apparatus as claimed in claim 9, wherein the trick play signal generating means 
is adapted to select a number of AC coefficients that may be variable for subsequent intra 
encoded pictures of said trick play signal. 

1 1 . Apparatus as claimed in claim 10, wherein the trick play signal generating 
means is adapted to select for the generation of an intra encoded picture of said trick play 
signal, for a current subpicture of said intra encoded picture, a number of AC coefficients from 
the corresponding subpicture of said intra encoded picture of said digital video information 
signal, said number having a relationship with the difference between the DC coefficient of the 
current subpicture of said intra encoded picture of said digital information signal from which 
the present intra encoded picture of the trick play signal will be derived and the DC coefficient 
of the previous subpicture of said intra encoded picture of said digital video information 
signal. 

12. Apparatus as claimed in claim 1 1 , wherein said number increases for an 
increasing difference. 

13. Apparatus as claimed in claim 1, wherein the trick play signal generating means 
are adapted to 

(a) retrieve I pictures from said digital video information signal, 

(b) generate P pictures, 

(c) merge said I pictures and said P pictures so as to obtain said trick play signal comprising 
groups of pictures, comprising an I picture followed by a number of n P pictures, the generated 
P pictures being such that, upon reproduction at said trick play speed, a P picture following an 
I picture results, upon decoding, in a repeated presentation of a picture obtained from decoding 
said I picture. 
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1 4. Apparatus as claimed in claim 7, wherein said trick play generating means are 

adapted to data compress an intra encoded picture comprised in said digital video information 
signal by deleting subpictures of the said picture, starting at the right hand side of the picture, 
towards the left hand side of the picture. 

1 5 Apparatus for recording a digital video information signal on a record carrier, 

the apparatus comprising 

- input means for receiving the digital video information signal, 

- tnck play signal generating means for generating a trick play signal from said digital video 
information signal, so as to enable a trick play reproduction at a speed m times the nominal 
reproduction speed, where m is an integer larger than 1 , 

- merging means for merging said digital video information signal and said trick play signal 
into a composite information signal, 

- writing means for writing said composite information signal in a track on said record carrier, 
said trick play signal generating means being adapted to retrieve intra encoded pictures from 
said digital video information signal, and are adapted to carry out a data compression step on 
said retrieved intra encoded pictures so as to obtain data compressed intra encoded pictures in 
said trick play signal. 

1 6 . Apparatus as claimed in claim 1 5 , wherein said trick play signal generating 
means is adapted to data compress intra encoded pictures comprised in said digital video 
information signal by lowering the resolution of said intra encoded pictures so as to obtain said 
data compressed intra encoded pictures of said trick play signal. 

17. Apparatus as claimed in claim 1 5, wherein said trick play signal generating 
means is adapted to data compress intra encoded pictures comprised in said digital video 
information signal by selecting a restricted number of AC coefficients of said intra encoded 
pictures so as to obtain said data compressed intra encoded pictures of said trick play signal. 

18. Apparatus as claimed in claim 1 7, wherein the trick play signal generating 
means is adapted to select a number of AC coefficients that may be variable for subsequent 
data compressed intra encoded pictures of said trick play signal. 
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! 9 Apparatus as claimed in claim 1 8, wherein the trick play signal generating _ 

means is adapted to select for the generation of a data compressed intra encoded picture of 
said trick play signal, for a current subpicture of said data compressed intra encoded picture, a 
number of AC coefficients from the corresponding subpicture of said intra encoded picture of 
said digital video information signal, said number having a relationship with the difference 
between the DC coefficient of the current subpicture of said intra encoded picture of said 
digital information signal from which the present data compressed intra encoded picture of the 
trick play signal will be derived and the DC coefficient of the previous subpicture of said intra 
encoded picture of said digital video information signal. 

20. Apparatus as claimed in claim 19, wherein said number increases for an 

increasing difference. 

2 1 Method of recording a digital video information signal on a record carrier, the 

method comprising the steps of 

- receiving the digital video information signal, 

- generating a trick play signal from said digital video information signal, so as to enable a 
trick play reproduction at a speed m times the nominal reproduction speed, where m is an 
integer larger than 1, 

- merging said digital video information signal and said trick play signal into a composite 
information signal, 

- writing said composite information signal in a track on said record carrier, 
said trick play signal generating step comprising the substeps of 

(a) retrieving intra encoded pictures from said digital video information signal, 

(b) generating inter encoded pictures, 

(c) merging said intra encoded pictures and said inter encoded pictures, so as to obtain a trick 
play signal comprising subsequent groups of pictures, comprising an intra encoded picture, 
followed by a number of n of said generated inter encoded pictures, where n is an integer 
larger than 0, the generated inter encoded pictures being such that, upon reproduction at said 
trick play speed, an inter encoded picture following an intra encoded picture results, upon 
decoding, in a repeated presentation of a picture obtained from decoding said intra encoded 
picture. 
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22. Method of recording a digital video information signal on a record carrier, the 

method comprising the steps of 

- receiving the digital video information signal, 

- generating means for generating a trick play signal from said digital video information 

5 signal, so as to enable a trick play reproduction at a speed m times the nominal reproduction 
speed, where m is an integer larger than 1 , 

- merging said digital video information signal and said trick play signal into a composite 
information signal, 

- writing said composite information signal in a track on said record carrier, 
1 0 said trick play signal generating step comprising the substeps of 

(a) retrieving intra encoded pictures from said digital video information signal, and 

(b) carrying out a data compression step on said retrieved intra encoded pictures so as to 
obtain data compressed intra encoded pictures in said trick play signal. 

15 23 . Record carrier having a digital video information signal and a trick play signal 

recorded on it, said digital video information signal being meant for a reproduction from said 
record carrier at a nominal play reproduction speed, said trick play signal being meant for a 
reproduction from said record carrier at a trick play speed m times said nominal reproduction 
speed, m being an integer larger than 1, said trick play signal comprising subsequent groups of 

20 pictures, comprising an intra encoded picture, followed by a number of n of inter encoded 
pictures, where n is an integer larger than 0, the inter encoded pictures being such that, upon 
reproduction at said trick play speed, an inter encoded picture following an intra encoded 
picture results, upon decoding, in a repeated presentation of a picture obtained from decoding 
said intra encoded picture. 
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(57) Abstract 

The invention relates 
to the generation of a trick 
play information stream from 
a normal play information 
stream, so that they can 
be recorded together as a 
composite information stream 
on the record carrier, such 
that upon reproduction in 
a trick play reproduction 
mode, an information signal 
of sufficient quality, e.g. 
as regards visibility, can 
be obtained. One aspect of 
the invention lies in the 
generation of GOPs, each 
GOP comprising an I-frame 
retrieved from the original 
normal play information 
stream, and one or more 
so-called "empty P frames". 
Another aspect of the 
invention is the requirement 
of generating GOPs for the 
trick play information stream 
that have a constant bitcost 

per GOP. Again another aspect of the invention lies in the retrieval of the I-frame for the trick play information stream from the normal 
play information. More specifically, an I-frame is generated by retrieving from an I-frame included in the normal play information, the 
DC coefficient of the I-frame and a number of AC coefficients from that I-frame and generate the I-frame for the trick play information 
stream therefrom. More specifically, the number of AC coefficients for an I-frame of the trick play information signal depends on the 
difference between the DC coefficients of two subsequent I-frames in the normal play information from which the I-frame to be generated 
and the just previously generated I-frame for the trick play information signal have been derived. 
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Invention 1 - Claims 3-5, 13, 21, 23 relate to trick play signals in 
a diqital video information recording apparatus. 

The special technical feature of invention 1 is that a second trick 
play signal for faster reproduction speed can be generated by 
selecting group of pictures from the first trick play signal. 

Invention 2 - Claims 6 relates to the bit cost of the groups of 
pictures of the trick play signal. The special technical feature of 
invention 2 is that these groups of pictures are generated with a 
constant bit cost. 

Invention 3 - Claims 7-12, 14-20, 22 relate to compression of the 
intra encoded pictures of the trick play signal. 

The special technical feature of invention 3 is that the intra 
encoded pictures of the trick play signal are compressed versions of 
the intra encoded pictures of the digital video information signal. 
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